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DETAILED ACTION 

1 . This Non-Final action is responsive to the RCE filed on II 1 9/20 1 0 & IDS filed on 
12/1/2010. 

2. In the continuation claims 1-10 & 13-28 remain pending. Claims 1, 6, 13, 18, 23 and 26 
are the independent claims. 



Withdrawn Rejections 

3. The 35 U.S.C. 102(a) rejections of claims 1-10 and 13-28 with cited reference of Yang 
has been withdrawn in light of the amendment. 



Information Disclosure Statement 

4. The information disclosure statement (IDS) submitted on 12/1/2010 has been entered, 
and considered by the examiner. 



Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 
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6. Claims 1-10 and 13-28 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yang (U.S. 6,301,586, filed on Oct. 6, 1997) in view of Agnihotri (U.S. 6,608,930, filed on Aug. 
9, 1999). 

Regarding Independent claims 1, 13 and 23, A computer-implemented method of 
generating a paper document based upon a plurality of multimedia documents stored as 
individual files in a file system, each storing multimedia information in electronic form, 
the method comprising: receiving information at a processor of a computer system 
identifying a selection criterion; retrieving with the processor of the computer system the 
multimedia information stored by each of the plurality of multimedia documents stored as 
individual files in the file system; determining with the processors of the computer 
system whether, based on the selection criteria portions of video information or audio 
information in the multimedia information stored by each of the plurality of multimedia 
documents that satisfy the selection criterion; extracting from each corresponding file in 
the file system the identified portions of video information or audio information in the 
multimedia information with the processor of the computer system including at least a 
first portion of video information or audio information extracted by the processor directly 
from a first multimedia document stored as an individual file in the file system and a 
second portion of video information or audio information extracted by the processor 
directly from a second multimedia document stored as an individual file in the file 
system ; and printing the portions of Video information or audio information in the 
multimedia information that satisfy the selection criterion using an output device 
associated with the computer system, including the extracted first portion and the 
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extracted second portion, on a paper medium to generate the paper document comprising 
a set of one or more printed pages. 

Yang discloses receiving information at a processor of a computer system identifying a 
selection criterion. He discloses identifying a selection criterion as using search related 
functions/query for searching and accessing databases to retrieve multimedia objects 
(column 7, lines 19-26). Column 24, lines 40-50 discloses "The real power of this media 
database management system is the powerful and flexible way to query the database 
system by using predefined criteria" thereby teaching identifying a selection criterion 
for identifying video clips or sound information. Yang further discloses (column 4, 
lines 60-64) "...data fdes, such as database files used by the multimedia object 
management system of the invention, audio files, text files, image files, video clip 
files." Thereby teachings that multimedia information stored by each of the 
plurality of multimedia documents are stored as individual files in the file system. 
Yang discloses printing the clips that satisfy the predefined criteria using an output 
device such as a printer that includes a first clip or from a first collection and a second 
clip from a second collection as a new collection on a paper medium to generate a set of 
one or more printed pages which includes the number of clips per page as specified by 
the user and disclosed in figs 19-21. Yang mentions video clips and audio data, however 
being stored separately and categorized as collections. Yang fails to explicitly teach 
extracting portions of video/audio data from a first multimedia document stored as 
an individual file, instead he identifies the video audio data residing in a collection. 
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Thus their is no extraction from a "multimedia document stored as an individual 
file". Agnihotri explicitly discloses extracting portions of video data from individual 
video files based on user criteria such as sports or a news program or particular 
event. These video files are video clips and the user criteria identifies portions 
relevant for extraction by searching for text within the video and separating the 
required portions for further processing and editing. Thus Agnihotri teaches the 
skilled artisan to extract relevant portions of data from individual multimedia files, 
a first or second or third as needed which are then saved and edited (see abstract & 
column 3, lines 5-60). At the time of the invention it would have been obvious for one 
of ordinary skill in the art to have modified the system of Yang to further analyze 
video clips stored as individual files. The motivation is that significant time is saved 
by searching for relevant portions of video data in lengthy video clips. 

Regarding Dependent claims 2 and 14, Yang discloses wherein printing the portions of 
video information or audio information in the multimedia information that satisfy the 
selection criterion using the output device associated with the computer system on the 
paper medium to generate the paper document comprises: printing text information on at 
least one page of the set of printed pages of the paper document using the output device 
such that words in the text information that satisfy the selection criterion are annotated, 
wherein the text information is extracted by the processor from the portions of video 
information or audio information in the multimedia information using one or more audio 
or video recognition techniques (see column 22, lines 42-55 & fig 22-23, which discloses 
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printing text information on a page as annotated data, the text information being extracted 
by the processor from the clips). 

Regarding Dependent claims 3 and 15, Yang discloses wherein printing the portions of 
video information or audio information in the multimedia information that satisfy the 
selection criterion using the output device associated with the computer system on the 
paper medium to generate the paper document comprises: printing one or more video 
frames on at least one page of the set of printed pages of the paper document using the 
output device such that at least one video frame that satisfies the selection criterion is 
annotated, wherein the one or more video frames are extracted by the processor from the 
portions of video information in the multimedia information (see column 22, lines 42-55 
& fig 22-23, which discloses printing text information on a page as annotated data, the 
text information being extracted by the processor from the clips). 

Regarding Dependent claims 4, 10, 16 and 22, Yang discloses wherein receiving the 
information at the processor of the computer system identifying the selection criterion 
comprises: receiving information at the processor identifying a topic of interest (Column 
24, lines 40-50, wherein querying includes identifying a topic of interest). 

Regarding Dependent claims 5, 17 and 25, Yang discloses wherein printing the 
portions of video information or audio information in the multimedia information that 
satisfy the selection criterion using the output device associated with the computer system 
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on the paper medium to generate the paper document comprises: generating a printable 
representation using the processor for the portions of the video information or audio 
information in the multimedia information that satisfy the selection criterion; and printing 
the printable representation using the output device on the paper medium to generate the 
paper document (see column 22, lines 42-55 & fig 22-23, which discloses printing text 
information on a page as annotated data, the text information being extracted by the 
processor from the clips). 

Regarding Independent claims 6, 18 and 26, A method of generating a paper document 
using multimedia information stored by a first multimedia document and a second 
multimedia document, the method comprising: 

Receiving, at the processor of a computer system, input identifying a selection criterion; 
Accessing with the processor printable representations for the first multimedia document 
and the second multimedia document; Analyzing with the processor the printable 
representation for the first multimedia document in response to the input to identify at 
least one portion of the printable representation that satisfies the selection criterion; 
analyzing with the processor the printable representation for the second multimedia 
document in response to the input to identify at least one portion of the printable 
representation that satisfies the selection criterion; generating a consolidated printable 
representation with the processor that includes the at least one portion of the printable 
representation for the first multimedia document and the at least one portion for the 
second multimedia document that satisfy the selection criterion; and printing the 
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consolidated printable representation using an output device associated with the computer 
system on a paper medium to generate the paper document comprising one or more 
printed pages. 

Yang discloses receiving information at a processor of a computer system identifying a 
selection criterion. He discloses identifying a selection criterion as using search related 
functions/query for searching and accessing databases to retrieve multimedia objects 
(column 7, lines 19-26). Column 24, lines 40-50 discloses "The real power of this media 
database management system is the powerful and flexible way to query the database 
system by using predefined criteria" thereby teaching identifying a selection criterion 
for identifying video clips or sound information. Yang further discloses (column 4, 
lines 60-64) "...data files, such as database files used by the multimedia object 
management system of the invention, audio files, text files, image files, video clip 
files." Thereby teachings that multimedia information stored by each of the 
plurality of multimedia documents are stored as individual files in the file system. 
Yang discloses printing the clips that satisfy the predefined criteria using an output 
device such as a printer that includes a first clip or from a first collection and a second 
clip from a second collection as a new collection on a paper medium to generate a set of 
one or more printed pages which includes the number of clips per page as specified by 
the user and disclosed in figs 19-21. Yang mentions video clips and audio data, however 
being stored separately and categorized as collections. Yang fails to explicitly teach 
extracting portions of video/audio data from a first multimedia document stored as 
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an individual file, instead he identifies the video audio data residing in a collection. 
Thus their is no extraction from a "multimedia document stored as an individual 
file". Agnihotri explicitly discloses extracting portions of video data from individual 
video files based on user criteria such as sports or a news program or particular 
event. These video files are video clips and the user criteria identifies portions 
relevant for extraction by searching for text within the video and separating the 
required portions for further processing and editing. Thus Agnihotri teaches the 
skilled artisan to extract relevant portions of data from individual multimedia files, 
a first or second or third as needed which are then saved and edited (see abstract & 
column 3, lines 5-60). At the time of the invention it would have been obvious for one 
of ordinary skill in the art to have modified the system of Yang to further analyze 
video clips stored as individual files. The motivation is that significant time is saved 
by searching for relevant portions of video data in lengthy video clips. 

Regarding Dependent claims 7, 19 and 27, Yang discloses wherein: analyzing the 
printable representation for the first multimedia document comprises determining at least 
one page in the printable representation for the first multimedia document that comprises 
information that satisfies the selection criterion; analyzing the printable representation for 
the second multimedia document comprises determining at least one page in the printable 
representation for the second multimedia document that comprises information that 
satisfies the selection criterion; and generating the consolidated printable representation 
comprises including the at least one page from the printable representation for the first 
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multimedia document and the at least one page from the printable representation for the 
second multimedia document in the consolidated printable representation (see column 6, 
lines 10-67, disclosing extraction of relevant portions based on a criteria including editing 
as shown in fig 23 comprising different images in a single page as desired by a user). 

Regarding Dependent claims 8 and 20, Yang discloses wherein printing the 
consolidated printable representation on the paper medium to generate the paper 
document comprises: printing text information on at least one page of the one or more 
printed pages of the paper document such that words in the text information that satisfy 
the selection criterion are annotated (see column 22, lines 42-55 & fig 22-23, which 
discloses printing text information on a page as annotated data, the text information being 
extracted by the processor from the clips). 

Regarding Dependent claims 9 and 21, Yang discloses wherein printing the 
consolidated printable representation on the paper medium to generate the paper 
document comprises: printing one or more video frames on at least one page of the one or 
more printed pages of the paper document such that at least one video frame of the one or 
more video frames that satisfies the selection criterion is annotated (see column 6, lines 
10-67, disclosing annotation of video frames). 

Regarding Dependent claim 24, with dependency of claim 23, Yang discloses wherein 
the code for printing the portions of video information or audio information the 
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multimedia information that satisfy the selection criterion on the paper medium to 
generate the paper document comprises: code for printing text information on at least one 
page of the set of printed pages of the paper document such that words in the text 
information that satisfy the selection criterion are annotated, wherein the text information 
is extracted from the portions of video information or audio information in the 
multimedia information; and code for printing one or more video frames on the at least 
one page such that at least one video frame that satisfies the selection criterion is 
annotated, wherein the one or more video frames are extracted from the portions of video 
information or audio information in the multimedia information (see column 22, lines 42- 
55 & fig 22-23, disclosing printing text information on the page with annotated words). 

Regarding Dependent claim 28, with dependency of claim 26, Yang discloses wherein 
the code for printing the consolidated printable representation on the paper medium to 
generate the paper document comprises: code for printing text information on at least one 
page of the one or more printed pages of the paper document such that words in the text 
information that satisfy the selection criterion are annotated; and code for printing one or 
more video frames on at least one page of the one or more printed pages of the paper 
document such that at least one video frame of the one or more video frames that satisfies 
the selection criterion is annotated (see column 22, lines 42-55 & fig 22-23, disclosing 
annotating the frames & printing text information on the page with annotated words). 
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It is noted that any citation [[s]] to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be 
considered to be limiting in any way. A reference is relevant for all it contains and 
may be relied upon for all that it would have reasonably suggested to one having 
ordinary skill in the art. [[See, MPEP 2123]] 

Response to Arguments 

7. Applicants arguments filed 1 1/5/2009 have been fully considered but are moot in view of 
the new grounds of rejection. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Manglesh M. Patel whose telephone number is (571) 272-5937. 
The examiner can normally be reached on M,F 8:30-6:00 T,TH 8:30-3:00 Wed 8:30-7:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen S. Hong can be reached on (571)272-4124. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Manglesh M. Patel 

Patent Examiner (AU 2178) 

February 11, 2011 

/Manglesh M Patel/ 
Manglesh Patel 
Examiner, Art Unit 2178 



/Stephen S. Hong/ 

Supervisory Patent Examiner, Art Unit 2178 



